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Abstract 


This  report  reviews  unobtrusive  research 
methods  from  a  variety  of  fields  for  application  in  Air 
Force  community  relations  program  evaluation. 

Its  purpose  is  to  provide  base  public  affairs 
personnel  with  an  overview  of  these  non-reactive 
measures,  including:  analyzing  physical  traces, 
monitoring  existing  data  and  simple  observation. 
Examples  are  given  of  creative  unobtrusive  applications 
to  current  community  relations  issues.  These 
applications  include  the  uses  of  content  analysis,  the 
semantic  differential  and  the  Delphi  Technique  to 
quantify  qualitative  data. 

An  extensive  annotated  bibliography  includes 
sources  on  above  subjects  and  case  studies  of 
evaluative  and  unobtrusive  research. 
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Abstract 


This  report  reviews  unobtrusive  research 
methods  from  a  variety  of  fields  for  application  in  Air 
Force  community  relations  program  evaluation. 

Its  purpose  is  to  provide  base  public  affairs 
personnel  with  an  overview  of  these  non-reactive 
measures,  including:  analyzing  physical  traces, 
monitoring  existing  data  and  simple  observation. 
Examples  are  given  of  creative  unobtrusive  applications 
to  current  community  relations  issues.  These 
applications  include  the  uses  of  content  analysis,  the 
semantic  differential  and  the  Delphi  Technique  to 
quantify  qualitative  data. 

An  extensive  annotated  bibliography  includes 
sources  on  above  subjects  and  case  studies  of 
evaluative  and  unobtrusive  research. 
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Research  is  a  wonderful  thing.  In  the  natural 
sciences,  fornal  research  has  led  to  the  advancement  of 
humanity  in  undeniably  profound  ways.  The  very  idea  of 
scientific  research  conjures  up  images  of  lab-coated 
old  men  with  beakers  and  white  mice  performing  sterile 
experiments  to  benefit  all  mankind. 

Why  is  it  then  that  the  term  "social  research" 

-  for  those  few  who  know  what  it  means  -  evokes 
shuddering  Images  of  complicated  surveys  of  imprecise 
questions  with  invalid  answers  getting  undeterminable 
results? 

Today  a  dominant  part  of  social  science 
research  is  done  through  interviews  and  questionnaires 
(Webb,  1966,  p.  1).  To  keep  up  with  the  accuracy  of 
scientific  research,  we  insist  these  measures  be 
precise,  reliable  and  valid  (Severin,  1979,  p.  13). 

The  result  is  often  a  complicated,  costly  and  time 
consuming  monstrosity.  By  the  time  it  has  been 
written,  typed,  pre-tested,  coordinated,  administered, 
correlated,  post-tested  and  reported  it  is  out  of 


mi 


Within  the  Air  Force ,  federal  and  military 
regulation*  and  restrictions  designed  to  proteot 
individual  right a  hsdper  Air  Force  Public  Affairs 
attitude  and  opinion  research.  The  Privacy  Act  of  1972 
Units  a  researcher's  access  to  oertain  demographic 
information.  Service  regulations  unit  the  kinds  of 
questions  a  military  Public  Affairs  off ioer  oan  ask. 
Public  affairs  people  find  they  neither  have  the  tine* 
expertise,  resources  nor  the  budget  to  understand  the 
nuances  of  goveranent  regulations  enough  to  produce 
reliable  and  Verifiable  progran  evaluation.  They  do 
not  know  the  reaeareh  process  well  enough  to  know  whloh 
unobtrusive  techniques  they  oan  use  to  eupplesent 
information  they  have  on  external  programs.  Of  tan,  the 
result  is  that  no  reasaroh  gats  dona. 

Yst  Air  Foroe  Publlo  Affairs  oannot  effectively 
function  without  this  feedback.  Bp  definition.  Air 
Foroe  Publio  Affairs  exists  to  provide  information  and 
maintain  an  awareness  snd  oonosrn  for  publlo  opinion 
regarding  an  organisation  that  is  owned  snd  operated  by 
and  for  the  Amerioan  peoplt  (Wood,  1983,  p.  1). 

The  publio  le  not  the  only  one  demanding  a 
responsive  Air  Foroe  publlo  affairs  progran.  Nora  and 
■ore,  oommanders  art  demanding  quantifiable  results 


feo*  public  if fairs  pro grass  to  justify  the  sonsy  and 

fr 

manpower  diverted  directly  fros  "the  sission"  -  aoney 
they  argue  that  could  be  better  spent  on  additional 
sen poser  slots  or  new  equipment. 

Those  in  need  of  research  find  themselves  in  a 
"Damned  if  they  -do ,  damned  if  they  don't"  situation. 

The  objective  of  this  paper  is  to  assess  the 
work  done  to  date  on  program  evaluation  methods,  with 
an  emphasiS  on  those  techniques  that  1)  remove  the 
researcher  from  the  reaearoh  scene,  2)  require  less 
expertise  to  use  than  more  formal  methods,  3)  lend 
themselves  easily  to  quantification  and  4)  show  promise 
of  application  to  Air  Force  community  relations 
issues. 

The  reader  may  find  more  sources  than  usual 
attributed  within  the  text.  This  paper  is  designed  to 
spark  oreative  applications  of  past  unobtrusive 
research.  Because  of  this,  footnotes  have  been  used 
liberally  to  provide  the  reader  an  opportunity  to 
further  researoh  eaoh  subject  or  case  study. 

Background 

Air  Foroe  Public  Affairs  cannot  afford  to  be 


"damned"  for  not  having  done  the  type  of  researoh  that 
provides  data  or  insight  into  public  opinion.  By 


definition.  Air  Force  Public  Affairs  exists  to  provide 
information  and  maintain  an  awareness  and  concern  for 
public  opinion  regarding  an  organization  that  is  owned 
and  operated  by  and  for  the  American  people  (Wood, 

1983,  P-  1). 

The  Public  Affairs  Role 

The  Public  Affairs  Officer's  (PAO)  role  is  to 
advise  and  assist  the  commander  in  the  many  specialty 
areas  of  public  affairs  so  that  the  oomoand  can  better 
accomplish  its  designated  mission.  The  PAO  delivers 
management's  message  to  employees,  the  media  and  local 
communities.  He  is  tasked  to  provide  prompt,  honest, 
and  factual  information  about  the  installation  (subject 
to  security  constraints).  He  is  a  policy  advisor, 
planner  and  Implementor  of  community  relations 
programs.  At  the  same  time,  the  PAO  is  the  "eyes"  for 
higher  echelons  of  Public  Affairs  -  the  Command  and 
Headquarters  Air  Force  levels. 

The  Air  Force  Public  Affairs  program  is 
traditionally  divided  into  three  functions:  internal 
communications,  community  relations  and  media  relations 
(Wood,  1983).  At  present,  Air  Foroe  public  affairs 
people  solicit  a  considerable  amount  of  internal 
feedbaok.  They  use  readership  surveys  to  measure  the 


effectiveness  of  their  primary  internal  oommunioatlons 
tool,  the  base  newspaper .  Most  bases  have  an  anonymous 
"Tell  It  To  The  Commander"  telephone  line  to  record 
complaints  or  laud  programs.  Interpersonal 
communication  is  used  with  "Commander's  Call"  meetings 
and  offloe  visits  by  the  commander  to  informally 
monitor  employee  attitudes.  Combined  results  from  all 
these  techniques  can  be  quantified  to  some  degree  and 
monitored . 

A  quantifiable  system  for  feedback  of  publics 
not  under  the  control  of  the  military  is  lacking.  Air 
Force  programs  at  the  base  and  command  levels  do  not 
routinely  monitor  for  changes  in  community  or  area 
media  attitudes  toward  an  installation  or  some  facet  of 
its  externally  oriented  programs.  Soanning  newspapers 
or  talking  to  Influential  city  officials  may  uncover  a 
latent  attitude  for  or  against  a  base  commander  or 
event,  but  it  does  not  provide  representative  and 
quantitative  feedbaok  about  general  attitudes  and 
opinions  toward  a  base  or  its  programs  over  the  long 
run.  Justifying  the  cost  effective  existence  or 
initiation  of  public  affairs  community  relations 
programs  to  a  commander  (and  the  Public)  takes 
carefully  gathered  facts. 

When  a  commander's  or  PAO's  actions  produce 
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Evaluation  faadbael  oila  ba  dtsoribtd  atvtral  . 
ways  -  qualitative  va.  qoantltativa ,  polity  planning 
▼a.  aval  nation  of  existing  pro  grans ,  obtruaiva  n. 
unobtruaiva. 

QUALITATIVE  EVALUATION  analysts  and  catagorlzas 
valuta ,  attitudas  and  othar  subjective  data  into 
non-nuaer  ioal  gtntraliatd  stateaents.  QUAXTITATIVE 
EVALUATXOE  uatt  aoisittiflo  techniques  that  enable  a 
rtaaarehar  to  naha  general ,  objective  (nuaerioal) 


11 


For  quantitative  evaluation  to  work,  it  must 
assume  that  resources  are  available  and  used,  that  they 
provide  equal  benefit  to  everyone  and  meet  everyone’s 
needs.  For  example,  by  limiting  data  gathering  to 
auditing  of  federal  expenditures  -  the  most  common 
quantitative  method  -  evaluators  only  see  the 
relationship  of  dollars  spent  to  program  effectiveness 
(Siedman,  1977,  p.  ^15).  Meanwhile  data  about 
recipient  needs  in  the  form  of  personal  experience, 
records,  reports  and  other  resources  go  untapped  for 
policy  development  or  program  evaluation.  Likewise, 
counting  the  number  of  visits  per  month  as  part  of  the 
base's  community  speakers  bureau  will  not  tell  a  base 
PAO  if  what  the  Women's  Garden  Club  heard  increased 
their  appreciation  of  the  base's  environmental 
position.  Validation,  not  explanation,  of  assumptions 
is  the  strength  of  qualitative  analysis. 

When  quantitative  and  qualitative  analysis  are 
used  together  or  if  qualitative  evaluation  can  be 
quantified,  the  result  is  the  support  demanded  by 
commanders  for  or  of  conclusions  and  policy 
recommendat ions . 

When  contemplating  evaluation,  it's  useful  to 
distinguish  here  between  two  broad  contexts.  The 
first,  POLICY  AND  PROGRAM  FORMATION,  evaluates  the 


%*;•:** 


appropriateness  of  or  potantial  for  tha  establishment 
of  a  profraa.  Tha  seoond,  EVALUATION  Of  EXISTING 
POLICY  and  progress,  datarninaa  whethsr  existing 
prograaa  ara  aoooapllahlng  thalr  objectives. 

Unobtrusive  raaaaroh  aethods  can  ba  uaad  effectively  in 
althar  oontaxt  (Rossi  A  Berk,  1981,  p.  288). 

OBTRUSIVE  RESEARCH  aethods  ara  thaaa  irhlah 
lntruda  into  tha  situation  studlad.  In  othar  words, 
the  subject  knows  ha  is  being  studied.  Examples  of 
obtrusive  aethods  include  surveys,  visible  oaasrae, 
interviews,  etc.  The  presence  of  certain  variables 
alaost  requires  unobtrusive  research  aethods.  A  desire 
for  social  acceptance  or  evaluation  apprehension  on  the 
part  of  the  subjeot  can  skew  results.  A  subjeot  aay 
have  a  desire  to  sabotage  the  results.  He  or  she  aay 
be  doing  what  they  peroeive  the  researoher  wants  then 
to  do.  Stern  (1979,  p.  71)  labeled  these  variables  the 
"On  Stage  Effects". 
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CHAPTER  ONE 

An  Overview  of  Unobtrusive  Research  Methods 


Why  should  this  research  be  unobtrusive? 

First,  most  forms  of  unobtrusive  research  are 
quantifiable  and  easily  updated.  Content  analysis,  for 
example,  is  an  effective  way  to  measure  the 
communication  channel  Itself  and  can  be  updated 
periodically  with  little  effort  (Babbie,  1979, 
p.  274).  Second,  unobtrusive  techniques  are  often  less 
complicated  and  in  many  ways  less  time  consuming  and 
less  expensive.  Using  existing  records,  if  you  know 
where  to  find  them,  can  eliminate  costly  surveys 
(Vogel,  1982,  p.  22).  Third,  it  takes  the  researcher 
out  of  the  research  situation.  Rank,  uniform,  even 
haircut  or  posture,  can  influence  responses. 

Similarly,  a  military  return  address  on  a  survey  can 
contaminate  research  results.  The  fourth  and  probably 
most  important  reason  is  that  military  and  federal 
regulations  prohibit  or  discourage  surveys  directed  at 
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ftiSIIIMi  raaulta .  ara ,  an  poworfui  nethod  - 

for  >ao«iriwp_  sooa  brtfcn  «»  part  of  * 

pro 0m  daalpa  IPauabut  irrelevant  to 

or  iii«**o*tt*p  for  anaodrinp  ¥lth 

prograa  loplanantatlon*  (ftooal  *  BOrk,  1981,  p.  289) . 

Moat  kind#  '  ir^ppiMrc^  bin  tie  ’ 

broken  down  -into  three  oateportea  aaoordlnp  to  tHo  _ 
oharaoter latlos  of  the  Oat a:  physical  traoaa ,  arohltea 
or  data  gathering 3). 
•Physical.  traoaa9  *o  tha  use  of  phya leal  oluea  aa 
indicators  of  tha  aaa  or  disuae  of  a  propra*  or  porta 
of  a  propria,  "ftrohivaa"  (alao  r afar rad  to  aa  Pal  at  lap 
Data  or  Saooadary  Analysis)  is  tha  study  of  public  and 
private  raoorda  which  halp  clarify  a  prograo  or  policy 
by  analysing  tranda .  "Observation"  la  tha  study  of 
audlenoea  or  individuals  for  inaipht  into  attitudoa  and 


behavior 


Lika  a  dataotlra  piaolnp  topathar  oluaa  at  tha 


phyalaal 


evidence  to  draw  conclusions  about  the  effectiveness  of 
his  progress. 

Worn  tilt  or  oar pat ,  for  lnstanoa.  oan  indioata 
tha  popularity  of  visitor  oantar  displays  (Webb,  1966, 
p.  36).  Tha  wear  and  taar  of  basa  nawspapars  or  basa 
newoaaer 'a  guides  in  a  doctor's  offioa  or  waiting  rooa 
■ay  indioata  Mangas  in  tha  intarast  or  naad  of  oartaln 
typas  of  lnforaatlon  whan  aaasurad  ovar  tine  (Wabb, 
1966,  p.  39).  A  PAO  night  son i tor  radio  dials  on 
autoaobllas  in  visitor  parking  plaoas  as  an  indication 
of  whara  to  "place"  radio  PSAs  for  proaotions  of 
prograaa  ilka  open  housas  (Wabb,  1966,  p.  37). 

Tha  following  exaaples  illustrate  soaa  of  tha 
applications  of  observing  physical  traces  in 
unobtrusive  resarch: 

—  Pour  woodworking  ooapanlas  purchased  new, 
prograaaable  wood  routers.  Ettlia  (1977)  sat 
up  an  unobtrusive  aethod  as  one  of  two 
independent  aaasuras  of  tha  aaae  variable  to 
increase  confidence  in  his  research  results. 

After  aaoh  aaohina  was  in  plaoa, 
Polaroid  photos  ware  unobtrusively  taken  froa 
tha  eight  ooapaas  points,  using  tha  aaohlne's 
basa  length  as  an  artificial  north.  Photos 
ware  taken  again  several  weeks  later.  Tha 


amount  of  sawdust  on  the  machine  and  its  bench 
became  an  indicator  of  acceptance  and  use  of 
the  machine. 

At  the  same  time,  woodworkers  at  each 
of  the  companies  were  contacted  by  the 
researcher  and  asked  to  report  over  the 
telephone  the  average  time  they  spent  each  week 
using  the  machine. 

The  self-reports  and  photos  matched 
when  ranked  one  to  four,  appearing  to  measure 
the  same  variable. 

--  Telephone  trucks  and  public  utility  trucks 
parked  in  front  of  fast  food  restaurants  were 
used  as  a  measure  of  lost  work  time  among 
employees  (Maddock,  Kenny,  Lupfer  &  Rosen, 

1  976,  pp.  1  99-203). 

Management  at  a  public  utility  in 
Tennessee  noticed  while  driving  through  the 
city  that  a  large  number  of  their  utility 
trucks  were  parked  at  fast  food  restaurants 
during  all  times  of  the  day  and  night.  They 
wanted  to  know  if  employees  were  spending  too 
much  time  at  this  obviously  non-productive 
activity . 


Since  workers  may  not  be  candid  about 
lost  work  time  and  any  "goofing  off"  or  "gold 
bricking"  may  not  be  apparent  when  an  employee 
knows  he  or  she  is  being  watched,  unobtrusive 
measures  were  needed. 

Researchers  drove  a  six  mile  route 
during  previously  established  morning  and 
afternoon  hours.  They  recorded  the  number  and 
types  of  the  public  utility's  vehicles  parked 
at  restaurants,  on  the  job,  or  driving  on  the 
road.  For  comparison,  they  did  the  same  for  a 
privately  owned  utility  similar  in  size,  the 
local  phone  company. 

In  all,  there  were  two  types  of  trucks 
by  three  possible  locations,  by  four  time 
slots.  This  produced  a  chart  with  2A  cells. 

Researchers  found  that  though  a  large 
number  of  trucks  were  sighted  at  restaurants, 
considerably  more  trucks  were  found  "on  the 
job".  [However,  during  one  of  the  time  frames 
-  when  the  World  Series  was  broadcast  -  almost 
all  the  trucks  disappeared  from  all  locations. 
Also,  more  phone  company  trucks  (at  a  ratio  of 
three  to  one)  were  found  at  fast  food 
restaurants . ] 
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Fhysloal  traoes  techniques  do  have  subtle 
pitfalls  which  »uat  be  kept  in  Bind.  Soae  types  of 
carpet  or  tile  w ear  better  than  others.  Where  a 
■age sine  la  placed  or  replaced  on  a  rack  say  influence 
its  visibility.  Radio  dials  tell  you  only  what 
stations  those  who  have  already  expressed  an  interest 
in  or  have  business  on  your  installation  listen  to. 

But  the  advantage  of  physioal  researoh  is  that  it 
o ire us vents  the  variable  of  subject  awareness  as  an 
influence  on  results  (Webb,  1966,  p.  50).  The  obvious 
disadvantage  is  its  imprecision.  It  is  a  more 
appropriate  Manure  of  the  extent  of  aotivity  than  the 
aotivation  behind  it  (Webb,  1966,  p.  52). 

Although  the  confidence  in  a  study’s  results 
may  be  enhanoed  by  agreesent  between  formal  research 
and  physical  traces,  it  is  also  possible  that  when  the 
two  approaches  do  not  matoh  one  of  them  nay  still  be 
valid  and  the  other  siaply  measuring  a  different  aspect 
of  the  sane  construct  (NoQrath,  1970,  p.  52). 


Data  Gathering 


One  of  the  aoat  expensive  and  time  consuming 


aspects  of  foraal  researoh  is  deteralning  sources  and 
gathering  the  lnforaation  needed  to  oompare  results. 
Many  times  this  Involves  surveying  a  randomly  aeleoted 


(pre-testing)  ts4  then  agal a  after  the  prograa 
COROlUdCS  (pOSt-tCSting). 

>  The  ass*  aedia  is  now  usss  by  cost  bass  Public 
Affairs  shops  as  a  judge  of  general  ooaaunity  attitudes 
for  or  against  the  installation.  By  aonltoring 

y  broadcasts  and  articles  presented  in  the  aass  aedia, 

and  categorising  each  story  as  either  favorable* 
unfavorable  or  neutral »  a  PAO  can  deteraine 

>  conaunication  problea  areas  with  the  aedia.  But  the 
use  of  the  Close  Procedure  (Sever in  A  Tankard,  1979, 
p.  83)  and  other  readability  tests  oan  deteraine 

I  whether  or  not  news  releases  and  apeeohes  generated  by 

the  base  will  be  understood  by  their  intended 
audiences.  Siailarly,  STARCH  tests,  or  variations  of 

g  thea,  have  provided  indications  of  article  or  photo 

recognition  and  oan  give  clues  to  editors  and 
advertisers  about  layout  and  content  effectiveness  for 


g  base  Internal  audiences. 

Local  coapany  personnel  statistics  oan  be  a 
welooae  souroe  of  data  -  when  available  -  for  a  PAO  who 
g  needs  background  inforaatlon  on  the  attitudes  of  a 

ooaaunity' s  work  force.  This  is  especially  true  in 
ooaaunities  where  a  few  corporations  eaploy  most  of  a 
m  coaaunlty.  If  re-enlistaent  rates  oan  be  used  to 


ittteata  in  the  *iu%iry ,  w&y  d*n* \ 

vm  mm  ftfcta*  m  mm  um  job  turnover  in  the  private 
•KM**  Certainly  the  OOUooO  bf  JoO  turnow  onn  hr  . 
anbigaows,  bat  f not  tn*t  tornoyor  h** 

lnereasad  or  deoreaeed  slgnif ieantly  can  indicate  a 
mo«  for  norn  aoawrate  attitude  raaoaroh  within  th« 


baoo  iteelf . 


•Sian  grievance  reoorde  Hava  boon  used  to  study 
raoial  aonfUot  (bsbb,  19*6,  p.  102).  in  suoh  oases.v 
Ulliiili  oar#  oategorisad  toito*ltor  fediu 
attitudes  and  aatioaa  against  Blacks  ago  Spanish- 
spssking  workers.  In  the  aaaa  sense,  lattara  to 
so— Kara  or  Squal  gnploynent  opportunity  (SCO) 
off  1  oar  a  oan  ba  mad  for  feedbaok  on  ailltary  progress 
and  tha  ooaaunlty'a  overall  attitudes  toward  that 


basa.  Ihasa  lattara,  however,  should  ba  oloaely 
exanined.  for  Instanoa,  whan  Xarox  Corporation  was 
flooded  with  negative  lattars  aftar  sponsoring  a 
television  sarlas  on  tha  Unltad  Rations,  it  hlrad  a 
group  of  handwriting  experts  to  examine  tha  nail. 

Ihasa  experts  found  that  tha  51 ,000  nagativa  lattars 
wars  actually  written  by  12,000  dlffarant  paopla,  a 
n unbar  squal  to  tha  n us bar  of  posltiva  responses  (Webb, 
1966,  p.  102).  This  "over -nailing"  oan  ba  fatal  to 
•d—a lity  relations  prograns  or  other  base  decisions 


-  'T 


isiss 


aie  ie  not  reoog»i*ed  .  s; 
L&^  ;W  •^I^UNn^  regulations  and 
t* Mi  lint  questionnaires  Is  to 


tit lor  aval labia  data  as  ooapar  stive  aster lal  (Vocal, 
1*62  .  p.  »}.  for  example ,  data  from  national,  atata 
or  city  censuses  oan  contain  mroraation  about  aga, 
alt,  family  si aa ,  occupation  and  housing .  Haalth 
statist los  oan  give  birth  and  daath  ratas.  Federal , 


stats  and  looal  institutions  oollaot  and  publish 
information  on  wages,  hours  of  work,  production, 
absent eel aa,  strikes,  financial  transactions, 
ate.  (Sallt is,  1960,  p.  316).  Voluntary  or ganlxat Ions 
often  hare  profiles  of  their  own  nanbarship  and  groups 
they  sar.ve .  Schools,  hospitals,  sooial  service 
aganolas,  personnel  departments  and  other  institutions 
often  administer  psychological  tests  of  one  kind  or 
another  to  their  entire  populations  (Selltis,  1960, 
p.  317). 

A  base,  for  exaaple,  oan  oonpare  its  high 
abssnteelsn  anong  civilian  or  ailitary  eaployees  with 
regional  or  local  ooaaunity  trends  to  quickly  deteraine 
whether  or  not  the  souroa  of  the  problem  is  within  the 
base  (indicated  by  inconalstaney  with  external  trends) 
or  generated  froa  outside  (indicated  by  a  consistency 
with  local  or  regional  trends). 
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In  another  example,  attendance  figures  at  union 
meetings  or  the  percentage  of  union  members  voting  can 
indicate  the  degree  to  which  members  are  concerned  with 
certain  issues. 

It  is  a  lucky  group  that  has  access  to  a  broad 
range  of  data  systems  or  has  as  a  member  someone  with  a 
nose  for  collecting  information  from  federal,  state  and 
local  special  interests  data  sources.  If  the  project 
is  well  funded,  long  term  or  important  enough,  a 
research  group  may  be  able  to  collect  and  continually 
update  a  library  of  sources  or  this  can  be  done  through 
contract  with  specialized  research  firms  (Greer  & 

Greer,  1982,  p.  155). 

The  "rates  under  treatment"  approach  develops 
estimates  of  target  populations  by  studying  the 
services  used  for  the  same  purpose  in  a  similar 
community.  The  assumption  is  that  the  characteristics 
of  the  two  target  populations  will  be  similar  as  well 
(Rossi,  Freeman,  Wright,  1979,  p.  105).  Air  Force 
bases  comparable  in  size  or  geographic  location  could 
share  community  relations  case  studies  and  data. 

The  sharing  of  statistics  and  the  opportunity 
to  retrieve  information  from  studies  or  records  of 
other  communities  or  agencies  appears  attractive.  One 
problem,  however,  is  the  limited  use  of  the  data. 


conclusions 


or  if  h*  m« 

^  •'  tut  data  an  : 

•valuator  wifi  •#$ "*6  use  as  t  bin  of  comparison  c«,Ud 
be  intentionally  or  unintentionally  inflated.  Tha 
rata*  under  treatment  approach  should  be  used  with  ' 
these  potential  pitfalla  in  wind. 

Moat  of  the  examples  diaousaed  so  far  involve 
way*  to  gather  etatl at ioa  already  ooapiled  by  others, 
the  information,  however*  is  often  general  and  the 
infetMioee  that  need  to  be  made  to  take  the  facta 
applicable  to  a  specific  problem  can  be  very  broad. 

One  way  to  foots*  the  research  is  for  a  PAO  to 
oondwet  his  or  her  own  tests  on  a  Halted  scale.  Tests 
on  the  effectiveness  of  a  community  program  can  be  as 
simple  aa  encouraging  an  audience  to  anonymously  oall  a 
publicised  number  to  discuss  the  program's  good  and  bad 
points.  If  it's  an  on-going  program,  or  if  manpower 
limitations  apply*  then  the  purchase  of  a  long-playing 
recording  device  can  serve  the  same  function. 

Tayler  and  Parker  (1964)  studied  the  use  of  an 
"attitude  report  question".  An  application  of  their 
method  could  involve  getting  a  random  selection  of 
pro-identified  opinion  leaders  to  answer  an  issue 


question  along  a  graphic  rating  scale  froa  very 
favorable  to  very  unfavorable.  Surprisingly,  this 
siaple  technique  has  been  found  to  be  as  reliable  as 
such  acre  ooaplicated  self-reporting  methods  (Oskaap, 
1977,  p.  M3).  An  obvious  liaitation  to  this  technique 
is  that  it  cannot  aeasure  aspects  of  the  rating,  only 
direction.  Tayler  and  Parker  suggested  that  adding  an 
essay  answer  requirement  about  the  question  could  be  a 
way  to  round  out  and  help  explain  aspects  of  the 
findings  (Oskaap,  1977,  p.  M3). 

Observations 

Seeing  is  believing  and  a  researcher  can  often 
pick  up  clues  and  insights  about  individual  and  group 
attitudes  and  behavior  through  siaple  observation. 

Personal  appearances  alone  may  give  clues  about 
the  orientation  of  an  employee  to  the  norms  of  his  work 
environment.  Haircuts,  make-up  and  even  tatoos  and 
scars,  when  ooapared  to  the  observed  norm  of  an 
organization,  can  give  clues  to  a  person's  perception 
of  what  is  normal  and  his  motivation  to  oomply  with 
those  norms  (Webb,  1966,  p.  116).  Clothes,  jewelry  and 
personal  possessions  oan  give  similar  clues,  though 
these  indicators  oan  refleot  other  variables  suoh  as 
wealth,  peroeived  social  status,  eto.  (Webb,  1966, 


wmgfe&sMk 


remaNe*  rim.-***  contest  m  wtuah  theyerenade  *****  *»t 
jump  to  conclusions  about  whet  the  apcaker  means. 


Conflict 


arises,  or  at  the  laaat 


i,  whan 


either  a  sender  or  receiver  mtaat  that  phrases 


"virtue*  ora  uni versally  understood  (Phillips ,  1 96$, 


liMMi 


o bear vat ion,  especially  whan  the  researcher  gathers 
facto  through  an  eyewitness,  ia  that  aaoh  parson's 
:  observations : of  avants  arc  intar prated . by  tha  aay  that . 
parson  paroeivao  tha  world,  fyewitness  reports  ara 
secondhand  information  and  should  be  treated  as  such*  . 
but  tha  sore  witnesses  that  collaborate  and  confirm  an 
observation  the  stronger  confidence  there  will  ba  in 
the  results. 

One  method  tangent  to  listening  is  for  tha 
researcher  to  use  the  voice  as  the  stimulus  in  his 
research .  for  example ,  "Black*1  and  "Shite"  voices 
dialing  "wrong  numbers"  on  the  telephone  have  been  used 


to  measure  raolal  prejudioe  (Gaertner  &  Bickman ,  1972, 
as  described  in  Stern,  p.  66). 

The  oallers  explain  that  their  car  has  broken 
down.  They  say  they  are  calling  from  a  phone  booth, 
had  been  trying  to  call  a  garage  and  are  now  out  of 
change.  Those  answering  the  phone  are  given  a  phone 
nuaber  and  asked  to  call  the  garage  with  a  message. 

A  researcher  at  "the  garage"  simply  tabulates 
the  results  which  oan  then  be  compared  to  other 
previous  sessions. 

In  this  case,  deception  is  used  to  trick  the 
subjeot  into  participating,  a  strategy  with 
questionable  ethlos. 

•Though  his  work  focuses  on  group  dynamics,  G. 

N.  Phillips'  statements  (Communication  in  Small  Groups, 
1966,  p.  68)  are  relative  to  unobtrusive  measures: 
"Members  should  also  be  alert  to  the 
nonverbal  behavior  of  their 
colleagues.  Facial  expressions,  hand 
gestures,  nods  of  the  head  and  body 
motions  oommunicate  significant  cues 
which,  if  responded  to,  would  be  very 
useful  in  understanding  the  feelings  of 
others.  Often  the  soft,  quiet  person 
will  try  to  express  his  opinions  in  the 
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form  of  non-verbal  cues." 

In  this  capacity,  unobtrusive  observation  can 
be  used  to  identify  those  individuals  the  researoher 
might  wish  to  further  study  obtrusively,  through 
interviews  or  surveys. 

Body  language  is  probably  the  quickest  and  most 
accurate  form  of  informal  feedback,  yet  the  most  subtle 
(Bogard,  1979,  p.  18).  It  can  be  so  subtle  at  times 
that  the  observer  is  unconscious  of  what  he  has  seen. 

A  PAO  attending  a  local  businessmen's  luncheon 
or  Chamber  of  Commerce  meeting,  like  a  good  detective, 
can  use  non-verbal  communication  as  cues  of 
unconsciously  expressed  attitudes  (Bogard,  1979, 
p.  15).  The  comfort  or  nervousness  demonstrated  by 
locals  around  someone  in  uniform  can  be  an  indication 
of  rapport.  Cliques  can  give  clues  to  informal 
channels  of  business  communication.  Seating  position 
or  the  order  in  which  people  answer  questions  may 
Indicate  a  kind  of  "pecking  order"  in  these  groups. 

Where  people  meet  and  how  they  gather  can 
indicate  to  a  communicator  where  to  focus  his  message 
for  the  most  exposure.  It  can  provide  some  insight 
into  group  interaction  as  well.  For  example,  Campbell, 
Kruskal  and  Wallace  (1965)  demonstrated  that  in  a 
classroom  with  optional  seating,  the  amount  of 
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alienation  or  interaction  between  Whites  and  Blacks  was 
an  index  of  the  degree  of  social  integrations  (Webb, 
1966,  p.  123).  Melton  (1935)  demonstrated  that  the 
closer  an  exhibit  is  to  an  exit,  the  less  time  will  be 
spent  on  it  (Webb,  1966,  p.  134).  Both  classroom  and 
exhibit  studies  indicate  the  importance  of  physical 
location  in  observation  evaluation. 

Timing  is  as  important  as  physical  location. 

One  cannot  judge  accurately  his  evaluation  of  body 
language  or  racial  interaction  without  considering  the 
biases,  limitations  or  influences  of  the  time  of  day, 
month  or  year.  Nor  can  he  ignore  the  connections 
between  behavior  and  recent  events,  trends  or  styles. 

Conclusion 

The  Air  Force  has  a  responsibility  to  keep 
informed  about  the  desires  of  its  "stockholders",  the 
American  public.  But  in  most  cases,  Air  Force  public 
affairs  people  can’t  just  go  out  and  ask  the  public  for 
feedback  on  local,  regional  or  national  issues. 

Privacy  restrictions  or  military  regulations  are  just  a 
few  of  the  barriers  to  gathering  this  data. 

One  of  the  few  ways  around  such  barriers  is 
unobtrusive  research,  which  can  be  broken  down  into 
three  main  categories:  physical  traces,  data  gathering 
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and  observation.  But  this  research  must  be  simple  and 
quantifiable  or  it  is  of  little  use  to  the  average  base 
public  affairs  office. 
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sis. 
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CHAPTER  TWO 


Quantifying  and  Reporting  Findings 

In  a  management-by-objective  climate  where 
progress  reports  are  made  to  commanders  weekly,  PAOs 
can  no  longer  use  the  excuse  that  they're  dealing  with 
qualitative  intangibles  hard  to  measure  and  harder  to 
report. 

In  his  book  Communication  and  Public  Relations, 
Edward  J.  Robinson  describes  RESEARCH  as  a  systematic 
attempt  to  obtain  reliable  knowledge.  The  term 
"systematic"  refers  to  goal -oriented  patterns  of 
logical  and  complete  steps  that  make  sense  intuitively, 
are  credible,  and  provide  useful  information. 

"Reliable"  suggests  the  results  aoourately  represent 
what  has  been  atudied  and  that  the  methods  used  give 
the  best  possible  evidence.  "Knowledge"  indicates  the 
results  should  reflect  some  degree  of  objectivity. 

Unobtrusive  research,  if  it  is  to  fall  under 
this  definition,  must  be  systematic,  reliable  and 


quant  tMtm  ^«***rch  has  already  bean  discussed »  but 
it  in  iaportant  her#  to  be  reainded  that  the  difference 

researoh  bat  in  the  tabulation  of  ltd  ran  data* 

One  of  the  siaplestweys  torepsrtreaearchis 
through  itea  response*  Mr  -  instance,  , ;; 

of  the  ear  radios  we  checked  were  tuned  to  WUUC ,  fifty 
percent  to  WYXX  and  the  remainder  to  a  variety  of  other 
stations « *  Another  'ia;  tor  ^  ■- 

- -'d!^0at.; dp»wdMr^aid[^^ *  '.::eoiWPdiinqr *  local  and  private 
data  and  nonitor  the  profiles  regularly  for  changes . 
frequency  distribution  aethods  oan  show  group  data  in 
tabular  fora  or  in  graphs  such  as  frequency  polygons , 
bar  graphs  and  pie  charts  (Oskaap,  1979,  p.  26). 
Baployee  absenteeisa,  for  exaaple,  oan  be  compared  with 
regional  absenteeisa  in  a  bar  graph. 

One  way  to  deal  with  written  notes  or  written 
qualitative  data  Is  to  stack  it  in  a  oorner,  oover  it 
up  with  a  sheet  and  use  it  as  sn  endtable.  Likewise, 
sobs  people  bury  their  qualitative  inforaation  in  a 
file  drawer.  At  least  an  endtable  oan  be  used*  A 


>,* 
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*1^1*111^^  eiid  Usbt mgs  and  official 

dodu#»nt**oeh .  as  letters »  meeting  alnutes ,  news 

V.;i  *•■ \"K\  ."•  v^;  .  •; 

r«lMMa,  etc.  into  an  unobtrusive  sources  of  ' . 


wished  to  seasure  public  opinion  about  the 
intant  of  a  certain  ooaaunity  work  organisation.  By 
Identifying  the  aost  frequently  reoocurring  topics,  aha 
developed  a  chart  with  four  calls*  Guidelines  for 
delegating  opinions  to  Oalls  wars  needed  so  a  check 
list  of  topic  oharaotaristi os  was  developed .  Ieoh 
opinion  expressed  in  Morris*#  soft  data  was  plaoad  in 
one  of  tha  four  topic  oat a for i as.  Sacausa  opinion# 
wars  often  aoooapaniad  by  exaaples,  Morris  could 
further  break  down  tha  topics  by  traditional  or 
innovative,  helpful  or  hindering  stateaents.  In  all, 
her  chart  totaled  24  different  categories  or  cells. 
Incidents  could  then  be  oounted ,  factored  and  analysed 
Into  what  aaounts  to  content  analysis. 


Moores  of  articles  and  books  have  been  written 


about  content  analysis.  Sons  of  then  are  listed  in  the 


:  'An^ohc' lttt«rm«d  m  t he 
technique  of  oontent  analys is  should  explore  these 
sources. 

for  this  paper ,  however ,  it  is  sufficient  to 
explain  that  oontent  analysis  is  a  social  science 
researoh  nethod  that  studies  oonaun  lost  ion  •’artifacts" 
instead  of  people  (i.c.,  printed  or  broadoasted  news, 
books,  photos  or  paintings,  etc.).  If  the  researoh 
Methodology  is  logical  and  Measures  are  taken  to  ensure 
as  auoh  objectivity  as  possible,  oontent  analysis  can 
be  used  to  quantify  qualitative  data* 

There  are  two  types  of  oontent  analysis 
approaches.  The  first  looks  at  directly  visible, 
objectively  identifiable  character 1st ice  of 
oonnunioation,  usually  words,  paragraphs,  books  and 
other  units  (Babble,  1983,  p.  284).  This  is  termed 
Manifest  oontent.  Latent  oontent  involves 


extrapolating  the  Meaning  within  ooamun lost ions.  This 
involves  subjeotlve  (but  consistent)  judgement  on  the 
part  of  the  evaluator. 

Today  with  the  ooaputer  as  a  common  piece  of 
offloe  equipment,  it  should  be  possible  to  oode 
observable,  statistical  and  physical  infornatlon  into  a 
prograa  and  oross-tab  eleaents  to  build  correlations. 

[I  have  not  yet  run  across  any  prepared  programs  for 


unobtrusi *e  research ,  tut  it  seeas  feasible .] 


As  sent ioaeS  before,  frequently  allltary  and 
civilians  Just  don’t  apeak  the  ease  language.  Words 
that  often  appear  In  business  -  like  ’productivity'  and 
'bottoa  line'  -  oould  be  subjected  to  seaantlc 
differential  testing  (Severin  A  Tankard,  1979,  p.  89). 
By  doing  Just  thirty  or  so  (15  with  ooaaunlty  business 
and  15  with  allltary  aanagers)  and  charting  the 
findings  on  a  XYZ  axis,  the  oonnotative  uses  and 
aeanings  of  such  buzz  words  aight  shed  light  on  the 

a 

sources  of  aiscoaaunloatlon  within  the  groups. 

The  seaantio  differential  Is  a  quantitative 
aethod  of  expressing  the  usually  qualitative 
connotation  of  words.  Basically,  It  involves 
Identifying  the  perceived  aeanings  of  three  categories 
of  words  on  a  polar  scale  of  seven  degrees  (Sever in  & 
Tankard,  1979). 

An  exaaple  would  be  the  question  asking  a 
respondent  to  plaoe  an  "X"  in  one  of  seven  boxes 
between  the  words  "Worthless"  and  "Valuable"  that  best 
describes  a  particular  prograa  or  policy.  The  three 
categories  of  words  are  an  evaluative  dimension 
(good-bad,  pleasant-unpleasant);  a  potency  diaension 


ntfftftf  iff t^Tr  sad  an  activity  dimension 

The  Kt»tM«f»  are  factored  and  the  naan  response 
is  then*  for  each  d teen si on.  The  three  eCana  are  then 
plotted  or  an  X-Y-Z  axis.  (The  X-axis  representing  the 
plane  of  evaluative  aeaning:  Y-axis  the  potency 
meaning;  and  Z-exis,  act ivi ty . )  If,  after  repeated 
evaluation  over  ties,  the  charted  point  aoves 
drastically,  a  change  in  the  oonnotative  meaning  of 
cords  nay  warrant  the  reassessaent  of  written  goals, 
regulations,  charters,  etc. 
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•The  Delphi  Technique,  on  the  other  hand*  is  a 
•ethod  of  eolioiting,  collecting,  interpreting  and 
reinterpreting  the  informed  judgements  of  groups  of 
experts  about  specific  issues  or  questions.  There  are 
three  aein  types  of  Delphi:  a  nuaerio  Delphi  which 
attempts  to  identify  future  nuaerio  ranges  of 
forscsstsi  s  policy  Delphi  which  atteapts  to  isolate 
answers  or  alternatives  to  current  or  expeoted  policy 
or  probleeai  and  a  historic  Delphi  whioh  looks  baok  at 
past  alternatives  that  could  have  been  used  to  miter  or 
influence  current  or  pent  polioiea  (Strauss  &  Zeigler, 


it 'V  .v: ,  i-\ 


Wanting  to  examine  how  the  great  philosophers 
of  the  past  would  suggest  society  solve  some  of  its 
contemporary  and  anticipated  problems,  Strauss  and 
Zeigler  built  panels  around  ten  political  philosophers 
-  Plato,  Aristotle,  Hobbes,  Machiavelli,  Swift,  Burke, 
Rousseau,  Locke,  Marx  and  Freud.  Each  panel  consisted 
of  six  experts.  The  Plato  panel,  for  example,  would 
consist  of  six  experts  on  Plato.  A  questionnaire  of  42 
three-part  statements  was  prepared  and  mailed.  Each 
statement  asked  the  expert  to:  describe  the  particular 
philospher's  point  of  view  on  a  similar  situation  of 
his  time,  discuss  how  he  would  have  reacted  then,  and 
how  he  would  solve  the  problem  if  alive  today. 

The  responses  were  collated  into  a  multiple 
choice  list,  ten  lists  in  all.  The  experts  were  then 
asked,  on  a  five-point  scale  from  strongly  agree  to 
strongly  disagree  to  rate  each  statement  on  the  panel's 
list.  What  evolved  was  a  consensus  of  options  of 
solutions  to  contemporary  problems  as  seen  through 
surrogate  eyes  from  a  philosophical  point  of  view. 

The  Delphi  method  has  proven  surprisingly 
reliable.  In  1964,  Robert  Ament  (1970,  as  described  by 
Strauss  and  Zeigler,  1974)  used  a  numeric  Delphi  to 
gather  estimates  from  a  panel  of  scientists  and 
technicians  on  innovations  in  the  physical  and 


biological  sciences i  weapons  systems*  automation  and 
space  as  well  as  projections  of  world  population  growth 
and  war.  It  was  repeated  again  in  1969  and  though  the 
experts  were  different,  the  panel's  forecasts  were 
similar . 

The  critics  and  advocates  of  the  Delphi 
Technique  are  many.  The  major  advantage  is  that  it  is 
simple  to  understand  and  implement  and  uses  a  minimum 
amount  of  numbers.  It  is,  however,  slow  and  time 
consuming.  If  mailed,  the  process  could  take  months. 

It  lacks  the  stimulation  of  face-to-face 
brainstorming.  Another  potential  problem  is  that  the 
evaluator  may  misunderstand  an  expert's  response.  The 
panel,  too,  could  be  so  homogeneous  as  to  skew  the 
results.  Despite  its  criticisms,  the  Delphi  is 
becoming  an  important  tool  for  evaluating  future  policy 
decisions  and  assessing  present  program  trends. 

Validity 

After  all  this,  an  evaluator  must  still  decide 
if  the  unobtrusive  methods  he  or  she  has  devised  will 
be  Internally  and  externally  valid. 

Any  researcher  claiming  a  causal  relationship 


between  variables  based  on  unobtrusive  methods  alone 
should  be  viewed  with  scepticism.  Causal  relationships 


assume  all  other  explanations  have  been  addressed  and 
discarded;  missing  or  overlooked  explanations 
invalidate  the  cause.  Observation,  oontent  analysis, 
the  examination  of  physical  evidence  and  other 
unobtrusive  methods  can  have  their  share  of  hidden 
relationships.  The  question  of  how  broadly  an 
evaluator  can  generalize  research  findings  is  the  issue 
of  external  validity.  How  applicable  are  the 
techniques  someone  else  once  used  for  other  reasons  to 
the  problem  at  hand?  Are  the  methods  or  findings 
useable  in  other  agencies  or  by  other  bases  or  do  the 
results  apply  to  only  the  program  tested? 

Conclusion 

It  is  prudent  here  to  review  what  has  been  said 
about  unobtrusive  measures.  First,  there  are  three 
general  types  of  unobtrusive  or  non-reactive  research  - 
the  analysis  of  physical  evidence,  the  interpreting  or 
reinterpreting  of  existing  records,  and  simple 
observation.  Second,  a  variety  of  ways  exist  to 
quantify  and  report  research  findings. 

So  far,  examples  have  been  given  which 
illustrate  possible  Air  Foroe  application  of  the 
non-reactive  methods.  But,  as  has  already  been  pointed 
out,  to  try  to  force-fit  specific  problems  to  existing 


techniques  creates  *  fallaoy  la  aethodology.  Aa  Wood 
states  in  the  DIMPOS  Handbook  (1983,  p.  7-7),  "A  aethod 
has  to  be  found  to  solve  the  raaaaroh  problaa  at  hand, 
even  if  an  entirely  new  aathod  aust  be  devised." 

Tha  next  chapter  will  review  currant  Air  Foroa 
unobtrusive  measures  of  publio  affairs  raaaaroh, 
dlseuss  chronic  Air  Foroa-wida  publio  affaira  issues 
(aa  identified  by  tha  Defenae  Information  School)  and 
suggest  possible  non-reaotive  aathoda  of  evaluation. 


CHAPTER  THREE 


Specific  Air  Force  Applications 

As  was  mentioned  before ,  the  Air  Force  Public 
Affairs  program  exists  to  provide  Information  and 
maintain  an  awareness  and  concern  for  public  opinion  as 
it  relates  to  Air  Force  programs,  members  and 
poliolea.  Since  the  organization  is  owned  and  operated 
by  and  for  the  Amerioan  public,  PAOs  at  the  local  level 
should  feel  a  sense  of  responsibility  to  the  community 
to  assist  the  needs  of  these  communities.  Too  often 
community  relations  activities  are  constructed  around 
the  needs  of  the  base  when  it  would  better  benefit  the 
base  to  "give  of  itself"  to  the  community. 

The  comraderle  and  loyalty  of  the  Air  Foroe 
member  to  his  closed ,  sheltered  sooiety  can  often 
inhibit  his  seeing  his  installation  as  a  part  of  a 
larger  community.  This  is  especially  true  when  the 
military  member  lives  on  base.  A  PAO  spends  much  of 
his  time  reminding  the  external  community  about  the 


local  impact  of  his  Air  Force  base  and  should  spend  the 
same  aaount  of  tiae  oooaunioating  the  Importance  of  the 
community  to  the  military  individual. 

In  this  capacity,  the  PAO  is  a  "boundary 
spanner*  (term  from  lecture,  Otto  Lerbinger,  Boston 
University,  1984),  -  the  oontaot  with  one  foot  Inside 
the  base  perimeter  and  the  other  on  the  steps  of  the 
local  city  halls.  Chambers  of  Commerce  and  town  meeting 
plaoes.  He  must  understand  and  feel  loyal  to  the 
community  and  the  Air  Foroe  installation  and  mission. 

In  addition,  he  must  keep  in  contact  with  other  base 
boundary  spanners  -  like  those  in  the  Judge  Advocate's 
Office,  Procurement,  Social  Actions,  Morale  and  Welfare 
-  to  know  the  overall  impact  or  influence  the  base  is 
having  on  the  community. 

There's  a  saying,  "You  don't  feel  the  breeze 
until  it  changes  directions."  Likewise,  the  impact  of 
an  Installation's  program  is  not  understood  until  it 
changes.  These  changes,  especially  when  unannounced, 
bring  Air  Force  Issues  into  the  front  seat  of  local 
attention . 

It's  important  that  the  PAO  know  the  local 
attitudes  and  opinions,  expected  behavior  or  reaotion, 
potential  conflict  and  support  that  these  issues  will 
influence.  What's  more,  he  or  she  should  be  able  to 
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eduoated  niUtar f off loare  ;i|jM&'  poorly 
eduoated  were  not  strongly  aware  of  our  other  way  to 
aooonpl iah  tasks  (Peppers ,  p.  25).  The  situation  today 
la  diffarant  and  ooMiunloatlon  techniques  must  change 
too  or  oaaaa  to  serve .  The  groat oat  neod  for 
inprovenent  la  in  that  area  of  tho  oonaunication 
process  oallod  feedback. 

Cor  tain  nathoda  for  gathering  feedback  are  sore 
appropriate  than  others .  depending  on  tho  kind  of 
mm 'Mar  inatanoe ,  environmental 


rttoliaainf-or  social  audits  are  iwhipriiti  when  the 
data  needed  dMls  with  su  organisation**  external 
environment.  Sooial  audits  snd  ooanunioation  audits  ;  v 
work  wall  when  researching  an  organisation  and  its 
publics .  Coaaunioation  and  sooial  audita  work  wall  for 
gat haring  inforaatlon  about  aaaaagaa  and  af foots*  but 
sooial  audits  do  not  effectively  aeasure  tha  resistance 
or  assistance  of  tha  sassaga  ohannal  (Lerblnger,  Otto* 
paraphrased  from  chart,  "Corporate  Usa  of  Public 


Relations  Research," 
1977,  p.  13). 


',  Winter, 


good  describes  audits  and  other  types  of  acre 
fornal  research  in  the  DXRPOd  handbook .  Yet  ha 
emphatically  states  Caaphasis  his,  1983,  pp.  7-10)  "The 


iaaedlate 


act leal  Methods .  such  as  analysis  of 


■eatings,  inforaal  surreys,  analysing  ’built-in’ 
feedback  (e.g.,  letters  to  the  editor),  and  using  field 
agents  (oontaots  who  are  'in  the  know’  in  specific 

areas)." 

One  of  the  unobtrusive  aethods  described  in  the 
handbook  is  the  use  of  available  governaent  data 
(p.  7/1/1 -6).  Included  in  this  appendix  is  a  list  of 
governaent  sources  and  an  exoellent  seotion  suaaarising 
the  inforaatlon  a  researoher  can  gather  froa  the 


national  Cans  us. 

A  saoond  appendix  (7/11/1-^)  foousas  on  tha  use 
of  case  studies  as  a  way  of  gathering  an  indepth, 
though  aoaewhet  subjective ,  historic  perspective  of  a 
given  subject. 

Chronic  Issues 


Soae  of  the  reocourring  Air  Poroe  community 
relations ‘issues  -  and  potential  PAO  headaches  - 
requiring  constant  evaluation  •  include  the  reduotion 
of  olosure  of  support  activities;  abrupt  expansion; 
annexation  of  Military  facilities;  changes  in  utility 
rates  for  service;  noise  or  increased  noise  from  the 
base;  Federal  Impact  Aid  changes;  community 
encroaohment;  environmental  ohanges  caused  by  the 
installation;  speolal  privileges  and  needs  of  military 
members;  bigotry  or  prejudice;  and  aocidents  or 
disasters. 

BASE  CLOSURES  may  be  the  most  traumatic  issue  a 
PAO  can  faoe  since  it  affects  the  lives  of  thousands 
and  threatens  the  livelihoods  of  thousands  more.  The 
'death*  of  an  Air  Force  base  could  conceivably  spell 
death  for  a  small  town  whose  major  income  comes  from 
the  servioes  and  support  it  provides  an  installation. 

In  the  case  of  a  base  olosure,  extensive  preliminary 


atu 41w  iri  made  by  a  base's  environmental  impact 
of floe.  Ilia  MO  plays  a  key  role  in  servicing  tha 
Information  naads  of  ilia  base  and  tha  community.  By 
obtaining  came  studies  of  past  closures  and  knowing  tha 
ooaaunlty  government  and  ooaaunity  action  power 
structures,  praoiaa  questions  froa  particular  audiences 
can  be  anticipated. 

ACCI DEBTS  AMD  DISASTERS  which  affect  tha  local 
community  can  range  froa  sail  planes  which  land  in 
backyards  (U.S.  Air  Force  Acadeay ,  author's  experience ) 
to  missile  ailo  explosions  (Daaascus,  AR,  1980).  Tha 
foraer  may  scare  a  faraar  or  two  and  gat  a  public 
chuckle  froa  a  one  paragraph  story  or  photo  caption  in 
a  newspaper  the  next  day.  It's  not  likely  to  affect  a 
base's  ooaaunlty  relations.  The  latter,  however,  oan 
os use  local,  state  and  federal  govarnaant 
nlsooaaunloation  and  local  panio .  When  the  snoke 
clears  and  the  aooident  inspection  team  is  inspecting 
the  disaster,  the  PAO  Bust  assess  the  damage  to  his 
coamunity  relations  program. 

Both  the  base  closure  and  aooident  disaster 
situations  are  ad  hoc  issues  needing  either  pre-  or 
post-event  evaluation  -  evaluation  using  unobtrusive 
aeasures  of  a  potentially  "hostile"  community. 

Changes  in  UTILITY  RATES  usually  happen  without 
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HM  nonths  Mfm,  the  county  had  changed  ltd  rates 
MS:  ;l|gXl^::,M9^  law  to  have  approval  fi^thi 
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ooatl«m*4  to  pay  the  outdated  anount.  Tits  teds  h«« 
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told  'Hid  eoeoty  it  weuld  release  the  entire  auspsyabie 
upon  Oife  approval.  6Ma# ;  o  f  f  idiaiS'Mdl^ :  to  prod 
QMS  intq  notion  wit*'  n '  lawsuit 
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Foroe  Publlo  Affairs  Case  Studied,  t 9931 . 

This  is  when  it  id  iaportaftt  to  get  out  of  the 
office  and  talk  to  eoanunitjr  leaders.  Encouraging  the 
entire  publlo  affairs  staff  to  get  involved  in 
eensunity  progress  at  all  levels  can  gather  a  wealth  of 
inside  Inf or nation.  Xf  the  of floe  is  understaffed , 
identify  Air  foroe  senders  or  retirees  m  local 
government  positions  who  can  provide  this  infomatlon. 
COMKKKXTX  BICtOACWttKT  and  POISE  COMPLAINTS 


fron  the 


itf*  have  a  not -too-aurpr  i sing 


relationship*  The  closer  a  ooanunlty  grows  around  an 


installation  with  a  flying  operation,  the  louder  and 
■ore  frequently  the  ooaaunlty  complains  about  noise. 
Though  flight  patterns  nay  have  existed  unchanged  for 
aany  years  and  in  soae  instances  oannot  be  changed 
(because  of  prevailing  winds,  mountains,  etc.), 
developers  oontinue  to  build  residences  under  air  paths 
and  faailies  oontinue  to  buy  thea. 

The  PAO  is  direotly  involved  in  coordinating 
and  writing  plans  to  ooabat  encroachment  and  then 
publicizing  these  plans.  If  the  plan  does  not  solve 
the  problea,  as  is  often  the  case,  the  PAO  aay  face  the 
wrath  of  organized  ooaaunity  action  oommittees  when 
aircraft  noise  becoaes  "intolerable"  during  exercises. 

The  ooaaander  of  one  Tactical  Air  Command 
Training  base  thought  that  the  local  community  would 
not  notice  the  roar  of  increased  F-HE  aircraft  night 
activities.  Against  the  advice  of  the  PAO,  the  base 
told  no  one  in  the  community  about  the  exercises  -  that 
is,  until  the  ooaaander  was  kept  up  all  night  answering 
phone  calls  froa  angry  citizens  (Air  Foroe  Public 
Affairs  Case  Studies,  1983). 

The  point  of  this  example  is  not  that  the 
ooaaander  should  have  listened  to  his  public  affairs 
director.  The  point  is  that  complaints  can  be  content 
analyzed  and  tracked  for  their  intensity  and 


direction.  Why  waste  all  that  inforaat ion -laden 
oritloisa  on  the  ooaaander? 

Though  the  ooaaander  will  always  get  oalls,  one 
way  to  short  eirouit  aost  of  thea  is  to  set  up  a 
telephone  recording  devioe  for  ooaaunity  questions. 

Many  bases  have  a  "Ooaaander ' s  Hotline"  for  base 
personnel,  why  not  a  ooaaunity  answers  line?  This 
publicized  reoording  oould  tape  questions,  ruaors, 
advice,  ooaplaints  or  pats-on-the-baoks  froa  ooaaunity 
ambers  about  an  installation's  polloies  or  prograas. 
Each  question  would  have  to  be  staffed  and  answered  as 
quiokly  as  possible.  Trends  end  audienoes  oould  be 
monitored  by  issue  categories  and  the  data  presented  in 
bar  graph  fora.  If  open,  credible,  two-way 
ooaaunloation  exists  it  can  aot  as  an  early  warning 
systea  to  potential  problem . 

Noise  ooaplaints  oan  develop  without  an 
enoroaohaent  problea.  In  1970  and  1971,  Air  Force 
radar  sites  and  a  snail  F-106  detaohaent  in  Klaaath 
Falls,  OR,  reoelved  sonio  boon  ooaplaints,  though  not 
at  all  responsible  for  the  noise.  Ooaaunity 
frustration  aounted  and  an  analysis  of  town  aee tings 
and  letters  to  the  editor  indloated  the  Air  Force  was 
beginning  to  suffer  a  regional  ooaaunity  relations 
problea.  Clips  and  suaaaries  of  broadoasts  and 
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■••tings  were  sent  to  Command  Headquarters,  Air  Force 
Public  Affairs.  The  Command  Public  Affairs  Office 
decided  to  time  and  log  each  boom.  They  then  consulted 
air  traffic  controllers.  The  pattern  of  sonic  booms 
matched  the  flights  of  supersonic  SR-71  aircraft 
originating  from  Beale  AFB  in  California.  Flight 
patterns  were  altered  and  favorable  community  relations 
were  restored.  In  a  second  example,  experimental 
tree-top  level  flights  were  conducted  over  sparsely 
populated  areas  of  Arkansas  and  Oklahoma. 

Unfortunately,  this  area  contained  the  heaviest 
concentration  of  poultry  raisers  in  the  world  and 
farmers  were  afraid  the  noise  would  cause  the  chickens 
to  stop  laying  eggs.  The  PAO  called  in  an  Air  Force 
film  crew  to  film  the  chickens'  reaction  to  the  noise. 
Though  the  chickens  were  startled  at  first,  it  was 
discovered  that  the  effect  lessened  with  successive 
fly-overs.  Farmers  were  satisfied  (Both  examples,  Air 
Force  Public  Affairs  Case  Studies,  1983). 

Both  of  the  above  examples  illustrate  the 
variety  and  scope  of  unobtrusive  techniques  available 
to  the  creative  PAO. 

However  long  the  Air  Force  has  been  dealing 
with  sonic  booms  and  encroachment ,  it  has  dealt  with 
the  issue  of  IMPACT  AID  longer. 
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Impact  aid  funds  are  those  monies  paid  by  the 
Department  of  Education  directly  to  local  school 
districts  to  partially  underwrite  the  cost  of  educating 
children  (one  of  whose  parents  is  a  full  time  employee 
of  the  Federal  Government  on  Federal  property)  in 
public  schools  (Gatto,  Community  Considerations,  198*0. 
This  includes  the  children  of  civilian  employees  as 
well.  Impact  Aid  began  in  1950  to  offset  the  funds 
school  districts  lost  because  they  could  not  tax 
federal  property.  Aid  increased  from  about  $30  million 
in  1950  to  $744  million  by  1980.  But  it  was  reduced  $53 
million  in  1981  and  by  1982  Impact  Aid  was  down  to  $456 
million.  It  went  up  to  $565  million  by  1984  but  is 
expected  to  be  reduced  to  approximately  $488  million  in 
FY  1985  (Gatto,  Community  Considerations,  1984).  This 
roller  coaster  funding  and  inflation  have  caused  budget 
crises  in  many  school  districts.  Districts  now 
strongly  lobby  their  congressmen  and  local  military 
leaders  to  support  increases.  Public  affairs  problems 
manifest  when  civilians  perceive  that  since  the 
military  benefits  from  taxes  paid  by  locals,  it  should 
take  the  responsibility  to  offset  costs  by  increasing 
Impact  funding.  Many  do  not  realize  that  budget  cuts 
are  not  the  choice  of  the  military,  nor  does  the 
military  have  control  over  Department  of  Education 
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generated  Impaot  Aid. 

Community  oriented  programs  designed  to  inform 
school  officials  and  sohool  affiliated  organizations 
require  a  feel  on  the  part  of  the  PAO  for  local 
attitudes  and  level  of  understanding  of  the  Federal 
bureaucratic  system.  Obtaining  School  Board  minutes 
and  newsletters,  monitoring  newspaper  editorials, 
scanning  School  Board  annual  reports  and  transcripts  of 
speeches  to  local  government  bodies  can  be  a  gold 
mine.  Content  analysis  can  then  be  used  to  quantify 
some  of  the  information. 

The  ENVIRONMENT  is  another  reoccurring  public 
issue  requiring  constant  attention.  Of  the  nation’s 
opinion. leaders  surveyed  in  a  recent  Gallup  Poll,  most 
felt  that  the  world's  big  problems  would  improve  before 
the  year  2000,  but  that  the  environmental  situation 
would  worsen  (Gallup,  1984).  Environmentalists  are 
active  again  after  a  few  quiet  years  in  the  late 
1970's.  They  have  more  power,  influence  and  grass  root 
support  than  ever  before  (Gallup,  1984). 

When  an  environmental  issue  surfaces,  the  PAO 
will  be  expected  to  advise  on  how  and  when  to  announce 
the  proposed  action,  help  determine  who  to  include  in 
the  initial  scoping  meeting,  provide  updates  to  the 
media,  serve  as  a  fooal  point  for  news  queries  and 


questions  from  government  and  oommunit y  leaders 
(Tar mo,  p,  W. 

From  what  has  been  writ tan  in  this  pa par ,  it 
should  ha  obvious  that  tha  PAO  suat  hava  dona  his 
homework.  Ha  should  know  what  othar  evants  ralata  to 
tha  aetlon  and  what  tha  ooabinad  affaot  is  likaly  to 
be .  This  oan  be  dona  by  obtaining  aaating  ainutas, 
agandas  froa  local  govarnaant  and  ooaaunity  action 
groups,  ato.  Ha  should  know  who  tha  kay  advooat as  and 
potential  advarsaries  are  by  aonitoring  local 
editorials  with  content  analysis. 

A  PAO  with  adequate  inf or nation  before 
everything  "hits  tha  fan",  will  ba  in  a  position  to 
defuse  adversity  by  proaoting  understanding  and  dispel 
ruaors  with  facts. 

Tha  following  is  an  example  of  this  volatile 
issue.  Tests  by  state  public  health  officials  in 
California,  revealed  traces  of  Triohloroethylene  ( TCE) 
in  walls  near,  but  not  on,  Mather  APB  in  1979.  TCE  is  a 
degreasing  solvent  used  by  tha  Air  Force  and  is  highly 
toxic.  Initially  tha  water  walls  on  base  ware  declared 
"clean”  and  tha  media  reported  it  as  such.  Two  months 
later,  minute  traces  of  TCE  ware  found  in  tha  on-base 
wells  but  slnoa  the  levels  were  below  Air  Foroa  set 
standards,  no  public  announcement  was  made.  When  the 


Mi6£i  found  out  about  the  tainted  wells  at  an  open  - 
meeting  between  baa©  engineers  «nd  the  eteta * s  Water 
Quality  Control  Beard ,  the  story  received  proainent 
attention  (air  Force  Publio  Affairs  Case  Studies, 

1983).  Again,  the  intent  of  this  example  is  not  to 
second  guess  the  PAO*  a  decision  not  to  release,  but  to 
illustrate  that  an  ongoing  aaaeasaent  of  the  changing 
environmental  profile  aust  be  done  in  order  to  better 
plan  policy  and  evaluate  the  aotual  or  potential  impact 
of  current  programs.  Public  affairs  programs  should 
not  be  thermostats  -  kicking  on  when  it  is  already  too 
hot.  A  PAO  should  know  the  sensitivities  in  his  or  her 
community  before  they  become  issues. 

It  is  also  neoessary  to  understand  the  'ego'  or 
ethics  of  the  media.  No  news  reporter  likes  to  be 
soooped  or  feel  like  the  PAO  has  at  the  most  deceived 
or  at  the  least  given  the  reporter  incomplete 
information.  The  way  a  reporter  feels  about  an 
organization  oan  influence  the  way  a  reporter  describes 
an  issue.  Journalists  might  argue  that  that  is  what 
editors  are  for.  But  a  PAO  can  decide  for  himself  the 
objectivity  of  news  stories  by  flagging  key  words  in  a 
story  as  either  positive,  neutral  or  negative  in  a 
simple  content  analysis. 

In  the  Gallup  Poll  quoted  earlier,  13  peroent 
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of  the  experts  listed  RACIAL  TENSIONS  as  one  of  the  top 
oonoerns  today.  Though  the  Air  Foroe  PAO  is  not  a  race 
relations  expert,  human  relations  specialist  or 
affirmative  action  officer,  he  must  be  able  to  identify 
his  role  in  this  issue. 

The  PAO's  role  is  to  support  the  Air  Foroe 
Equal  Employment  Opportunity  Program  by  providing 
Information  channels;  advice  and  expertise  on  effective 
communication;  and  adequate  support  of  the  program  by 
writing  articles  and  providing  other  technical  support 
(Gatto,  Minority  Relations  Seminar,  1984).  But  he  must 
do  more.  As  a  boundary  spanner  he  or  she  must  work 
with  the  base  EEO  officer  to  monitor  community 
attitudes  for  bigotry  and  prejudice  as  well  as 
community  perceived  discrimination  on  the  part  of  the 
installation. 

Klrtland  AFB  in  New  Mexico  is  a  good  example  of 
how  problems  can  evolve.  For  five  or  six  years  a 
movement  had  been  building  that  placed  the  base  in  the 
limelight.  Minority  groups  were  dissatisfied  with  the 
number  of  women  and  minorities  employed  by  federal 
agencies  in  the  area.  Kirtland  had  tried  at  length  to 
recruit  and  promote  minorities  but  not  necessarily  to 
inform  the  community  about  their  effort.  The  situation 
deteriorated,  with  minority  leaders  calling  news 


coarerehocs  and  making  soeusat ions  against  the  bees. 
Finally,  the  Secretary  of  the  Air  Force  received  e 
letter  free  two  Bcw  Mexico  senator s  end  * i  oon^eeanan 
requesting  tHe  BBO  Connleaion  end  the  Gorernaent 
Accounting  office  conduct  an  investigation.  After  on 
intensive  public  affairs  program  of  briefings  to 
congressional  and  ninority  groups  and  news  nedia 
visits,  the  • leper captions  were  corrected  (Air  Force 
Public  Affairs  Cass  Studies.  1981). 

It's  possible  that  stronger  relationships  with 
the  ninority  nedia  could  have  defused  the  issue 
earlier.  Monitoring  the  ninority  nedia  provides  a 
source  of  ninority  information  rich  in  attitudes  and 
opinions.  A  PAO  can  content  analyse  ninority  attitudes 
or  stands  on  real  or  potential  issues.  Minority  media 
can  be  used  to  reaoh  specific  ninority  publics.  What's 
nore,  denographic  information  about  minorities  is 
available  from  many  broadcast  nedia  as  a  public 
servloe . 

Public  affairs  people  nust  oomaunicate  to  all 
relevant  publios  about  polioles  that  effect  the 
oonaunlty.  To  do  this,  boundary  spanners  nust  avoid 
negative  stereotyping  and  racial  sensitivities  in  their 
everyday,  faoe-to-faoe  and  written  oonnunioation  - 
including  the  way  they  disseminate  information. 


If  an  issue  can  be  identified  early  enough  or 
COMMUNITY  NEEDS  discovered  before  an  issue  surfaces, 
the  PAO  may  have  an  opportunity  to  polish  the  base's 
image.  Planning  ahead  for  a  reputation  of  cooperation 
is  an  excellent  investment.  By  monitoring  the  needs  of 
a  community  through  an  audit  of  a  community's  public 
facilities,  the  base  may  be  able  (within  regulations) 
to  offer  its  facilities  to  the  public  when  not  in  use. 
Cooperative  fire  and  police  agreements  are  two 
examples.  Basketball  or  football  fields  on  'open 
bases'  are  under-used  during  the  duty  day  and  might  be 
made  available  to  the  local  community.  The  reputation 
for  cooperation  that  develops  can  go  a  long  way  to 
decrease  misunderstanding  when  a  PAO  may  need  it  most. 

Besides  a  review  of  community  facilities,  one 
way  to  identify  community  needs  is  to  ask  every  base 
organization  to  request  (as  routine)  an  after  action 
report  from  any  group  it  may  work  with  on  any  community 
project.  Included  in  this  report  would  be  copies  of 
all  letters  that  may  come  in  (whether  positive  or 
negative)  from  those  sources  the  program  Influenced. 
These  after  action  reports  can  give  a  researcher 
insight  into  Individual,  family  or  organizational 
needs. 

Finally,  the  military  member  and  his  or  her 


nriapcnaat  tiHB  that  !!*•  sot  rMdily  understood  by 

<&vi*i*pi'* ;.  : 

v  TheaSspeelalissues  vary  by  geographical  4&f. 
looatlon  and  aany  are  often  specific  to  one 
installation.  They  can  be  chronic  or  one  ties  events 
that  ones  solves  never  surface  again.  For  eaanple, 
because  of  a  strong  liquor  coalition,  one  Air  fores 
Base  eould  not  open  a  package  stere  on  its 
installation.  Another  - bsPi^i^iiifcriftniiei  had  problems 
cashing  cheeks  anywhere  in  the  ooaaunlty,  despite  the 
installation's  excellent  credit  reputation  (doth 
exasples,  Air  Force  Public  Affairs  Case  Studies,  if 83). 

The  key  to  these  different  issues  is  often  in 
avoiding  "the  defeating  dynaaloe  of  dlsagreeaeat as 
Jeroae  Peppers  put  It  in  AFJ  Log  Capring  1983,  p.  25). 
"Misunderstanding  nay  be  profitable  but  disap’ssaSnt  Is 
not.  Identify  and  handle  aisunderstanding  before  it 
turns  into  violent  disagreeasnt  that  creates  lapossible 
barriers  to  ooaaunloatlon."  A  PAO  Should  monitor  the 


reports  of  potential  adversaries,  their  events,  the 
attitudes  of  Mahers  as  expressed  in  editorials  or 
public  stateaents.  He  should  defuse  aisunderstandlngs 
as  soon  as  possible,  yet  at  the  same  tlae  realise  that 
sons  groups  (as  seen  in  the  Kellis  AFB  utility  rate 
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toroat JiiSiili/f Ur  oatagoru*  in  nunaroua  ;: 

W*an  or*ani*ad  by  iaaon.  though  and  leapt  up  to 
data ,  » ***>'  can  aaa*ht  tnlsaue  in  ninutaa ,  improving .; ... 
hit  rampant#  tint.  An  organised  information  bank  it 
alto  an  affieiant  war  tor  a  nav  P AO  to  ba coma  familiar 
with  an  iatua  at  toon  at  ha  or  aha  arrivat .  Chart  A  it 
an  axampla  of  what  thould  ba  Inoludad  under  aaoh 
part loan t  iasua  in  an  information  bank. 


Chart  A 


FILE  ONE:  Issue  synopsis  -  a  one  or  two  page  summary  of 
problem,  tangent  influences ,  affected  audiences ,  past  base 
actions  or  decisions. 


FILE  TND:  Anal  research  done  on  or  lapsoting  issue. 
Environmental  impact  statement ,  for  example,  if  issue  is 
environment.  Formal  surveys,  comuni ty  audits, 
communication  audits,  existing  thesis  or  dissertation 
information  on  issue.  Copies  of  applicable  federal  laws, 
base  regulations  or  where  to  find  them. 


FILE  THREE:  Specific  information  on  similar,  past 
experiences,  case  studies,  articles  or  newsclips  (including 
content  analysis),  audience  assessments,  letters  of 
complaint,  community  action  group  or  local  government 
offioe  profiles,  handwritten  notes  of  observation,  other 
historio  data. 


FILE  FOUR:  Techniques  and  sources  to  monitor  and  assess 
present  situation.  Cirrent  afteraction  reports,  public 
facilities  audit  (if  applicable),  list  of  cirrent  officials 
and  news  media,  handwritten  notes  of  observations  or 
comments  from  conversations,  meeting  minutes,  newsletters, 
ourrent  complaint  letters,  analysis  of  "Comuni ty  Answers 
Line,"  etc. 


How  to  Organise  an  Issue  in  an  Information  Bank 


order  to  evaluate  base  ooaaunity  relation#  policies  and 
programs  as  well  as  assess  the  lwpact  of  the  progress 
of  other  boundary  spanners . 

Several  external  Issues  say  Influence  the  PAO's 
profile  of  iaportant  issues.  Aaong  these  can  be 
changes  in  Federal  law,  shifts  of  power  due  to 
governaent  reorganisation,  and  the  appearance, 
disappearance  or  lack  of  certain  ooaaunity  notion 
groups . 

Existing  records,  content  analysis,  and 
observation  have  been  or  can  suppleaent  foraal  research 
in  a  variety  of  reooourring  ooaaunity  Issues  such  as 
base  closures,  changes  in  utility  rates,  noise  and 
enoroaohaent ,  environaental  lapaot.  Federal  Iapaot  Aid, 
prejudice,  aooident  iapaot  assessaent,  as  well  as  a 
score  of  installation-specific  problems. 


Suaaary 


The  techniques  of  soolal  research  are  as  varied 
and  colorful  as  those  in  the  mo re  foraal  natural  and 
physical  sciences. 

Yet  because  the  questions  deal  ultimately  with 
the  aoti vat ions  and  needs  of  Man  -  individually  and 
collectively  -  social  research  is  often  harder  to 
quantify. 

' Researchers  should  use  the  more  formal . 
scientific  aethods  whenever  possible.  But  because  Man 
is  so  coaplloated,  even  the  validity  of  true 
experlaental  researoh  is  suspect.  Unobtrusive  research 
is  one  way  to  supplement  more  formal  research  and 
increase  confidence  in  the  results. 

Unobtrusive  measures  are  generally  categorized 
three  ways.  The  analysis  of  physical  traces  can  be  an 
effective  way  to  measure  the  level  of  activity  of  a 
program.  It  falls  short,  however,  when  used  to  measure 
aoti vat ions  behind  the  activity.  Simple  observation 
has  the  saae  disadvantage.  Though  seeing  is  believing. 
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it  is  difficult  to  assess  the  motivations  behind 
observed  activity.  Interpreting  existing  data  has  the 
advantage  of  adding  extra,  unpaid  staff  to  an 
evaluation  question  --  someone  else  has  already  done 
the  data  gathering.  Its  drawbacks  stem  from  problems 
with  external  validity,  or  over-generalization. 

If  internally  and  externally  valid,  however, 
non-reactlve  methods  can  provide  insight  into  behavior 
that  cannot  be  measured  with  obtrusive  measures. 
Employee  "goldbr icking"  and  the  acceptance  through 
actual  use  of  a  new  wood  router  are  Just  two  examples. 

A  dozen  or  so  more  can  be  found  in  the  annotated 
bibliography  which  follows. 

Social  scientists  use  unobtrusive  methods  when 
it  is  necessary  to  remove  the  evaluator  from  the 
research  scene  for  fear  of  contaminating  the  results. 

A  military  uniform  or  rank  can  influence  a  subject's 
response  and  contaminate  results  as  well.  Military  and 
Federal  regulations  discourage  or  prohibit  surveys 
directed  at  civilians,  usually  to  protect  prvacy.  In 
many  cases,  unobtrusive  methods  can  be  less  time 
consuming  or  costly  and  less  complicated. 

Depending  on  the  methodology,  research  results 


O 


come  in  two  forms  -  qualitative  and  quantitative 
Qualitative  means  that  numbers  have  not  yet  been 


assigned  to  ooi* tain  values  or  attitudes  in  a  response . 
Ways  to  oonvert  qualitative  into  quantitative  data 
include  the  many  fores  of  oontent  analysis*  the 
aenantio  differential  with  its  X-Y-Z  axis,  and  the 
Delphi  Technique.  As  pro  grans  be  cone  available, 
ooaputers  will  aake  easier  the  tabulation  of 
qualitative  data.  It  is  iaportant  to  realize*  however, 
that  the  evaluator *s  aubjeotive  Judgement  will  always 
be  neoesaary  when  reforaulating  values  into  nuabers. 

More  and  nore,  oonaanders  are  asking  for 
quantitative  data  to  defend  the  oost-effeotive 
existence  of  present  prograas  or  to  support  new  policy 
changes.  The  PAO  can  build  ooaaunity  profiles  of 
qualitative  and  quantitative  data  of  reoccurring  Air 
Force  ooaaunity  issues  such  as  base  closings,  the 
environaent*  prejudice,  encroachment,  noise  complaints, 
etc . 

By  aixing  and  matching  techniques  and 
developing  creative  applications  of  their  own,  PAOs  can 
build  better  cooperation  and  understanding  between 
their  base  and  the  ooaaunity . 

As  Jerome  Peppers  wrote  ( AFJ  Log,  Spring  1983, 

p.  26 )t 

"Human  cooperation  is  a  function  of 

understanding.  Understanding  is  a 


function  of  effective  communication. 
Effective  communication  demands 
feedback  with  both  parties  involved  in 
a  dynamic  two-way  process.  It  is  the 
( PAO’s )  responsibility  to  create  the 
climate  in  which  effective 
communication  becomes  a  common  goal." 
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Selected  Annotated  Bibliography 


Very  few  books  have  been  written  on  unobtrusive 
research  methods  and  none  have  been  written 
specifically  for  public  relations  or  public  affairs. 

The  'bible'  on  unobtrusive  research  is  the  one  most 
often  quoted  in  this  report,  Webb,  Campbell,  Schwartz 
and  Sechrest's  Unobtrusive  Measures;  Nonreactlve 
Research  in  the  Social  Sciences. 

Because  little  has  been  done  with  the  public 
affairs  applications  of  unobtrusive  research,  this 
selected  annotated  bibliography  draws  together  a 
scattered  variety  of  references  ranging  from  general 
textbooks  to  technical  articles.  Most  of  the 
references  come  from  one  of  three  fields:  Public 
Relations,  Social  Science  Research  or  Education.  Since 
most  of  the  current  unobtrusive  research  appears  to  be 
generating  from  the  Education  sector,  a  large  amount  of 
the  case  studies  listed  here  can  be  obtained  through 
ERIC,  the  Education  Research  computer  index. 

The  Defense  Information  Handbook,  PA  Research 
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Methods  section,  includes  an  exhaustive  annotated 
bibliography  of  general  public  relations  and  public 
opinion  topics,  communication  processes,  Journals  and 
magazine  indexes,  reference  material  and  Department  of 
Defense  research  sources.  Those  topics,  therefore, 
have  not  been  duplicated  here. 

The  general  subject  of  unobtrusive  measures  has 
been  divided  into  the  subtopics  of  physical  evidence; 
existing  data;  observation;  quantitative  techniques; 
general,  background;  and  general.  Air  Foroe.  One 
source  may  cover  several  subtopics  but  will  be  listed 
only  under  the  one  subtopic  it  best  addresses.  Though 
lengthy,  it  might  be  wise  for  an  inquiring  reader  to 
scan  the  entire  bibliography. 

Physical  Evidence 


Bouchard,  T.  J.  "Unobtrusive  Measures:  An  Inventory  of 
Findings."  Sociological  Methods  and  Research,  April 
1976,  pages  217-3007 

Though  unobtrusive  methods  are  weak  when  used  alone, 
when  combined  with  formal  methods ,  they  can 
compensate  for  subject  reactions  to  the  evaluator. 
Excellent  article  categorizing  biographical  data  on 
work  done  in  all  areas  of  unobtrusive  research  but 
exceptionally  thorough  review  of  physical  traces 
references  and  non-reactive  research  technology. 

Brechner,  Kevin  C.  and  others,  "A  brief  report  on  a 
device  for  unobtrusive  visual  recordings."  Journal 
of  Applied  Behavior  Analysis,  Fall,  1974, 

pp.  559-500.  - — 

Short  article  describes  the  mechanics  of 
constructing  a  portable,  inexpensive  remote 


controlled  caaera  device  for  observation.  Suggests 
placing  suoh  a  devioe  above  head  level  behind  bright 
lights. 


Ettlie,  John  E.  "Validation  of  an  Unobtrusive  Measure 
of  Technological  Utilization.”  Psychological 
Reports,  1977.  PP.  123-128. 

Ettlie  uses  the  aeasure  of  sawdust  aooretion  on  a 
new  autoaated  (prograaaable )  production  wood  router 
as  an  unobtrusive  aethod  to  ooapare  self-reported 
use  with  physical  evidence.  He  explores  the 
generalize bility  of  dust  aooretion  and  the  need  to 
use  unobtrusive  aeasures  as  a  supplementary  rather 
than  priaary  measurement. 

Haddock,  Richard  C. ;  Charles  T.  Kenny;  Michael  B. 
Lupfer;  and  C.V.  Rosen  "A  Nonreactlve  Measure  of 
Lost  Tlae  Among  Employees."  Journal  of  Psychology, 
March,  1976,  pp.  199-203. 

The  study  of  publlo  utility  and  telephone  trucks 
parked  at  fast  food  restaurants  can  serve  as  an 
unobtrusive  measure  of  lost  work  time  among 
employees.  Artiole  illustrates  the  differences 
looation,  time  and  outside  events  can  have  on 
researoh  results. 

Palaer,  Jean  and  Frederick  L.  McGuire  "The  Use  of 
Unobtrusive  Measures  in  Mental  Health  Research." 
Journal  of  Consulting  and  Clinical  Psychology,  June 
1 973,  PP •  431 -436.  (ERIC  Document  Reproduction 
Servioe  No.  EJ  081  99*0. 

Use  of  physical  surroundings  of  mental  health 
facilities  as  an  unobtrusive  supplement  to  analysis 
of  readmission  rates,  length  of  stay  and  ratings 
received.  Correlations  found  between  physical 
appearance  and  ratings. 

Thelin,  John  R.  "Beyond  the  Factory  Model:  Sew 

Strategies  for  Institutional  Evaluation."  College 
and  University,  Winter  1976,  pp.  161-164.  (ERIC 
fiooument  Reproduction  Service  No.  EJ  131  235). 
Suggests  the  use  of  unobtrusive  measures  of  the  way 
schools  treat  constituents  as  a  supplement  to 
surveys.  Includes:  artifacts,  signs,  clues  from 
architecture,  spatial  arrangements,  movements,  and 
ceremonies . 

Wolf,  Robert  L.  and  Barbara  L.  Tymitz  "A  Preliminary 
Guide  for  Conducting  Naturalistic  Evaluation  in 
Studying  Museum  Environment."  Researoh  in  Education 


Flaherty,  Buga ale  Walsh  and  others ,  "Use  of  on 
Measure  for  the  Evaluation  of 

at  mm«* 

Ho.  EJ  18*  153). 

The  use  of  exi at lng  raoorda  to  evaluate  interagency 
coordination.  Though  tha  aganoiaa  involved  in  thla 
study  wars  early  childhood  development  oriented*  it 
may  have  applications  to  the  federal  levels. 
Advantages  and  disadvantages  are  discussed. 

Greene ,  Janes  E.  and  others,  "Using  Administrative  Data 
as  Unobtrusive  Indicators  of  Teaching  Performance 
Bcacaroh  in  gducatlon.  Deoeaber,  1983.  (ERIC 
Document  Reproduction  Service  No.  ED  232  590). 

An  unobtrusive  measure  of  tOaoher  performance  by 
assessing  their  student  following  (e.g.,  taking 
additional  courses  with  instructor).  Measures  five 
years  of  grade  data  and  other  records,  comparing 
this  unobtrusive  measure  with  student  end  of  course 
faculty  evaluations. 

Huebner,  Robert  B.  and  others,  "Assessing  Local  Mental 
Health  Need i  A  Multi  Method  Strategy.”  Research  in 
Education,  June  1979.  (BRXC  Document  Reproduction 
Service  Mo.  BD  165  062). 

Studies  the  impaot  of  a  program  on  its  community. 
Sooial  indicators  and  oenaus  data  were  evaluated,  a 
survey  administered  to  the  community,  and  client 
statistics  analysed  by  a  mental  health  agency  to 
produoe  a  profile  of  community  needs. 

Nesvold,  Betty  A.  "Instructional  Applications  of  Data 
Archive  Resources."  Amerloan  Behavioral  Scientist. 
March/April  1976,  pp .“T$!Pi6t>.  ( ERlc  Document 

Reproduction  Service  No.  EJ  136  909). 

Notes  that  the  computer  oan  be  used  to  prooess 
sooial  science  data  arohives  into  useful  research 
information. 


Parker,  Edwin  B.  and  others,  "Bibliographic  Citations 
as  Unobtrusive  Measures  of  Scientific 
Communication."  Researoh  in  Education.  June  1969. 
(Brio  Document  Reproduction  Servioe  No.  ED  026  075). 
An  unobtrusive  study  of  scientific  topics  stated  or 
reported  in  behavioral  solenoe  index.  Intent  was  to 
disoover  trends  by  subject  and  author  and  the  number 
of  interconnected  or  repeated  references. 
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Haynes,  S.  N.  and  J.  B.  Waokwlts  "DigitakCodlng  and 
Computer  Analysis  of  Bfhavlor  Obaarvatlon  Data." 
Journal  |f  Applied  Paha v lor  Analysis.  Wlntar  1975. 

Short  art! ola  describing  eiceotly  how  to  raoord  and 
analyst  behavior  through  park-sensitive  foraa  and 
praprograaaad  oosputer  analysis.  Mant ions  coat  and 
oonputar  prograa  aouroaa.  Long  Hat  of  applicable 
situations. 

Halnar,  0.  "Delphi  and  Short  Tara  For toasting." 

Futures,  torll  1977.  pp»  17i*2. 

hi  sous sea  proa  and  oona  of  Dal phi  Technique  ovar  the 
short  and  long  tara. 


Holst i,  Ole  R.  Content  Analysis  for  the  Soolal  Solenoea 
yd  Humanities'!  Reading,  MA:  Add!  son -Wesley,  1969. 
handbook  on  the  uses  of  content  analysis  as  they 
relate  to  the  characteristics  aeasured  and 
inferences  about  cause  and  effect.  Stresses 
methodology  and  coding,  with  an  extensive  chapter  on 
computers  and  their  uses  in  content  analysis. 

Larrabee,  Harold  Reliable  Knowledge  Solent ifio  Methods 
in  the  Social  Sciences,  rev.  ed.  Boston:  Houghton. 
Mimin',  1964. - 

Stresses  the  importance  of  formal  logic  in  social 
science  research,  Including  the  clear  formation  of  a 
hypothesis.  Applies  a  combination  of  hypothesis  to 
Legal  and  Governmental  situations:  court  cases, 
precedent  setting,  government  polioy  setting. 

Loftland,  John  Analysing  Soolal  Settings.  Belmont, 

CA:  Wadsworth,  1971. 

Part  One  discusses  Quantitative  analysis  of  social 
settings.  Part  Two  deals  with  the  collection  and 
management  of  Qualitative  Materials.  Excellent 
handbook  of  direct  relation  to  unobtrusive  research 
methods . 


Norris,  Margaret  "Problems  in  the  Analysis  of  Soft  Data 
and  Some  Suggested  Solutions."  Sociology,  August 
1981,  pp. 337-351. 

Artiole  discusses  what  to  do  with  those  answers  to 
open  ended  questions  and  evaluator  notes  and 
observations  that  pile  up  after  administering  a 
survey.  Norris  describes  ways  of  establishing 
reliability  and  validity  in  information  that  may  be 
a  year  or  more  old. 

Payne,  Stanley  L.  The  Art  of  Asking  Questions. 

Princeton,  NJ:  Princeton  University  Press,  1951. 

An  lndepth  look  at  the  planning  and  preparation 
needed  to  train  properly  survey  administerers . 
Includes  the  proper  way  to  phrase  and  order 
questions  on  a  survey. 

Rossi,  Peter  H.,  Howard  E.  Freeman  and  Sonia  R. 

Wright.  Evaluation  -  A  Systematic  Approach. 

Beverly  Hiiis,  6a:  Rage  Kibiioatlons,  Inc.,  1979. 
Textbook  useful  to  the  practicing  evaluator  and 
student  in  applied  social  evaluation  resear oh. 
Dissects  evaluation  researoh  into  program 
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General,  Background 


Boruch,  Robert  F.  and  others  "Recommendations  to 
Congress  and  Their  Rationale:  The  Holtzman 
Project."  Evaluation  Review,  February  1983, 
pp.  5-35.  (ERIC  Document  Reproduction  Service 
No.  ED  238  91  H)  . 

Recommendations  made  to  Congress  and  Department  of 
Education  to  improve  evaluation  of  federally 
supported  education  programs. 

D'Aprix,  Roger  M.  The  Believable  Corporation.  New  York 
City:  AMACOM,  1 1TT- 

Stress  the  importance  of  credibility  in  a  business' 
dealing  with  the  public.  Very  general  without  many 
case  studies  or  examples. 

Gallup,  George  Jr.  and  William  Proctor  Forecast  2000. 
New  York:  William  Morrow  and  Company "i  Inc  . ,  1  98H. 

By  using  a  combination  of  present  trends,  an 
analysis  of  youth  attitudes  and  the  Delphi 
Technique,  Gallup  has  listed  here  projected  major 
concerns  and  issues  he  expects  the  world  to  face  in 
the  year  2000. 

Hirsch,  Paul,  Peter  B.  Miller  and  Gerald  F.  Kline 
Strategies  for  Communication  Research.  Beverly 
Hills,  CA :  Sage  Publications,  Inc.,  1  977. 

The  more  formal  research  methods,  such  as  surveys 
and  interviews  make  up  the  thrust  of  this  book. 

Some  information  on  content  analysis,  but  mostly 
stresses  the  quantitative  data  collection  methods 
for  formal  research. 


Hodgkinson,  Harold  L.  and  John  Thelin  "Survey  of  the 
Applications  and  Uses  of  Unobtrusive  Measures  in 
Fields  of  Social  Service."  Research  in  Education, 
May  1972.  (ERIC  Document  Reproduction  Service  No.  ED 
958  863). 

Discusses  an  eight  week  pilot  study  of  current 
(1971)  uses  of  unobtrusive  measures.  A  directory 
and  examples  of  organizations  using  unobtrusive 
measures  by  field  is  included.  Criteria  used  by 
study  to  define  unobtrusive  methods  were  clues, 
traces,  signs,  patterns  or  records. 

Krupar ,  Karen  R.  Communication  Games :  Participant  *  s 
Handbook.  New  York:  Free  Press,  iy ?$. 

The  practical  approach  of  using  communication  games 


%  1 


c 


Rossi  ,  Peter  H.  and  Riohard  A.  Berk  "An  Overview  of 
Evaluation  Strategies  and  Procedures."  Human 
Organization .  Winter  1981,  pp.  287-299. 

An  indepth  look  at  the  different  types  and  uses  of 
evaluation  researoh.  Includes  a  checklist  of 
questions  to  ask  about  the  policy  or  program  before 
trying  to  evaluate  it.  Examples  and  case  studies. 

Sever in,  Werner  J.  and  James  W.  Tankard,  Jr. 

Communication  Theories:  Origins,  Methods,  Uses.  New 
York:  Oxford  University  Press,  1979. 

Textbook  on  fundamental  communication  theories, 
including  indepth  descriptions  of  Semantic 
Differential  and  oontent  analysis. 

Webb,  Eugene  J. ;  Donald  T.  Campbell;  Richard  D. 
Schwartz;  and  Lee  Sechrest  Unobtrusive 
Measured:  Nonreactlve  Research  in  the  Social 
Sciences"  Chicago:  Rand  McNally,  1966. 

Quoted  by  almost  every  other  author  who  has  written 
on  unobtrusive  research,  this  is  the  foremost  book 
on  the  subject. 

Weech,  Terry  L.  and  Herbert  Goldhor  "Obtrusive  versus 
Unobtrusive  Evaluation  of  Reference  Service  in  Five 
Illinois  Public  Libraries:  A  Pilot  Study."  Library 
Quarterly,  October  1982,  pp.  305-324.  (ERIC 
Document  Reproduction  Service  No.  EJ  271  561). 

Test  in  an  Illinois  library  discovered  that  library 
staff  answered  questions  correctly  more  often  when 
they  knew  they  were  being  evaluated .  Copy  of 
questionnaire,  report  form  and  references  provide 
clear  methodology  for  other  applications. 


General,  Air  Force 


"Air  Force  Public  Affairs  Case  Studies,"  Public  Affairs 
Department  Defense  Information  School,  Ft.  Benjamin 
Harrison,  Indianapolis,  IN,  1983. 

Collection  of  77  case  studies  from  AF  PA  personnel. 
This  collection  of  incidents  and  disasters  touches 
on  major  &  minor  problems  from  noise  complaints, 
plane  crashes  and  missile  silo  explosions,  and  drug 
busts  to  poisoned  pigeons,  talks  with  Santa  and 
transvestites . 


Arterburn,  Keith,  Lt.  "State  and  Local  Government." 
Lecture  notes  on  community  relations,  unpublished 


USA  Publio  Affairs  Department,  Defense  Information 
School,  Ft.  Benjamin Barr i son,  IN,  January  1984. 
Background  information  on  local  governmental 
structure  and  list  of  potential  Publio  Affairs 
community  relations  problems . 

Gatto,  Leonard  M. ,  JOC,  USN  "Community  Consideration.” 
Leoture  notes  on  community  relations,  unpublished. 
Public  Affairs  Department,  Defense  Information 
School,  Ft.  Benjamin  Harrison,  IN,  November  1983. 
Notes  used  to  leoture  students  on  community  issues. 
Topics  include  Impact  Aid  and  eoonomio  impact .  Hay 
be  difficult  to  obtain. 


Gatto,  Leonard,  M.,  Chief  Journalist,  USN  "Minority 
Relations  Seminar."  Leoture  notes  on  community 
relations,  unpublished.  Public  Affairs  Department, 
Defense  Information  Sohool,  Ft.  Benjamin  Harrison, 
IN,  March  1984. 

Notes  used  to  leoture  students  on  minority  related 
issues.  May  not  be  generally  available. 

Gatto,  Leonard,  M.,  Chief  Journalist,  USN  "Reporting 
Minority  Affairs."  Leoture  notes  on  community 
relations,  unpublished.  Public  Affairs  Department, 
Defense  Information  Sohool,  Ft.  Benjamin  Harrison, 
IN.  March  1984. 

Notes  used  to  leoture  students  at  Defense 
Information  School.  Topics  include  minority  media 
and  EEO  complaints.  Unpublished,  may  not  be  easily 
obtainable . 


Peppers,  Jerome  G.,  Jr.  "The  Military  Leader  —  A 
Manager  of  Communication  (The  Feedback  Process)." 
AFJ  Log.  Spring  1983. 

Excellent  article  about  the  importance  of  good 
managerial  communication  and  the  need  for  feedbaok. 
Article  has  applications  for  a  more  macro  look  at 
getting  feedbaok.  Author  writes  about  the  12 
guidelines  managers  should  keep  in  mind  when 
communicating,  from  written  critiques  to  timing  and 
selecting  the  right  media  for  the  message. 

Mood,  Charles  A.,  editor  Public  Affairs  Handbook,  third 
edition,  Indianapolis,  “li:  Ft.  fimjamin  karri  son, 
1983. 

Main  text  of  the  Defense  Information  Sohool  and  the 
"bible"  for  military  publio  affairs  officers. 
Inoludes  an  extensive  annotative  bibliography  of 
publio  affairs,  public  relations,  index  and 
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